Histopathology in 3D: From 3D Reconstruction to Multi-stain and Multi-modal Analysis

Light Microscopy applied to the domain of histopathology has traditionally been a two dimensional imaging modality. Several authors, including the authors of this work, have extended the use of Digital Microscopy to three dimensions by stacking digital images of serial sections using image based registration. In this paper we give an overview of our approach, and of extensions to the approach to register multi-modal data sets such as sets of interleaved histopathology sections with different stains, and sets of histopathology images to Radiology volumes with very different appearance. Our approach involves transforming dissimilar images into a multichannel representation derived from co-occurrence statistics between roughly aligned images.